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RIGIDITY AND SMOOTHNESS OF MOTION 


The smoothness assumption in measuring visual motion 

The problem of measuring visual motion is, in many situations, undercon¬ 
strained. That is, the information in the changing image is insufficent to 
determine the motion uniquely. This indeterminateness is often referred to as 
the “aperture problem” (for example Marr and Ullman, 1982). An additional 
constraint is therefore required for resolving the ambiguity and determining 
the velocity field uniquely. An important constraint that has been proposed 
for solving the problem is a smoothness constraint. (Fennema and Thomp¬ 
son 1979, Horn and Schunck 1981, Hildreth 1984, Nakayama and Silverman 
1986). When applied to the problem of measuring the velocity of image con¬ 
tours, this smoothness assumption has been formulated by Hildreth in the 
following manner. Of all the velocity fields that are consistent with the trans¬ 
forming image, select the velocity field that minimizes the overall variation. 
That is, if v denotes the velocity at a point, and s the arc length along the 
curve, the preferred velocity field is the one that minimizes the integral: 

/■£>’* 

along the curve (the principle of least variation). It has been shown that 
this method of determining the velocity field gives good results under a wide 
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range of conditions, and it seems to correspond in many cases to the velocity 
field perceived by human observers (Hildreth 1986, Nakayama and Silverman 
1986). 

Justifying the smoothness assumption. 

The main rationale raised in support of the smoothness assumption is that 
the velocity field induced by smooth contours in motion is expected to be 
smooth. This argument is insufficent, however, for justifying the principle of 
least variation. The smoothness assumption implies that if the object is known 
to be smooth, the velocity field should not contain discontinuities. It does not 
imply, however, that “the smoother the better”. Consider, for instance, two 
points in the image separated by a small distance, and moving with image 
velocities V x and V 2 . One may argue that if they lie on the same surface, 
extremely high values of ||Vj — V 2 \\ are unlikely, because of some physical 
limitations on the motion of objects in space. But why should one assume 
that a relative velocity of, say, 0.2 deg/sec is less likely than 0.1 deg/sec? Such 
a preference is assumed by the least variation principle (that favors velocity 
fields in which the difference in velocity between neighboring points is as small 
as possible), but cannot be defended only on the basis of a general smoothness 
argument. Clearly, a stronger constraint than just the general smoothness of 
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surfaces is required. 

Another general property that seems to provide a useful constraint in the 
analysis of visual motion is rigidity. Computational studies have shown that 
the 3D stucture of rigid and quasi-rigid objects can be recovered by looking 

for the most rigid interpretation possible of the changing image (Ullman 1979, 
1984). 

In this paper we argue that local rigidity of the object and the principle of 
least variation in the velocity field are related. To investigate this we consider 
a rod moving in three-dimensional space. The rod is allowed to move in a semi- 
rigid manner, it can rotate and translate freely and is also allowed a certain 
expansion. We calculate the relative velocity between the two endpoints of 
the rod, as projected on the image plane. The calculations show that under 
a wide range of conditions this velocity distribution is peaked at zero velocity 
and decreases monotonically at higher velocities. As a result, the projected 
velocity field of points linked rigidly together is likely to be consistent with 
the principle of least variation in the velocity field. There are two factors 
contributing to this strong bias towards small differential velocities in the 
projected velocity field: (i) the rigidity of the link between the two points and 
(ii) the effect of projection from 3-D to the 2-D image plane. 

If we imagine an object being made up of a collection of semi-rigid rods 
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this analysis suggests that the projected velocity field is likely to be smooth. 
We conclude that the principle of least variation is a reasonable constraint 
that can be justified for the projected velocity field of rigid or locally rigid 
objects. 

Section 1. The two-dimensional case. 

First we consider a rigid rod moving in two dimensions and being pro¬ 
jected onto a line. Because it is rigid the rod’s velocity can be split into 
rotational and translational components. For our purposes the translational 
component can be ignored as it will not contribute to the derivative of the 
velocity field on the line. 

Let the projected length of the rod be R and the real length be r, the 
angle to the vertical be 9 and the angular velocity be u>. Then the projected 
velocity distribution $(u) is 

$(n) = J 6(R- rsin9)6(u - ru cos 9)$ r (r)$u(u)drdwd9 (1.1) 

where 6 denotes the Dirac delta function, $ r (r) and $„(<*;) are the distribution 
of r and uj respectively, rsinO and rw cos ^ are the projected lengths and 
velocity respectively. We assume that rods are equally likely to have any 
length between 0 and T max and set $ r (r) = k between 0 and r max (with 
k^max ~~ 1 )• 
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We can integrate with respect to 9 using the first delta function. This 
gives (see Appendix 1) 

/ r=r maj . 

-o v'r^- & 6( < u ~ uj ^ r2 ~ R 2 )$u(u)drdu. (1.2) 
We integrate with respect to r to obtain 



< 9 $ 

du 



■_ M^min) _ 

2 + u*)f (ri at - R 2 nR 2 ^Ln + « 2 )' 


(1.4) 


So, for any probability distribution $„(uj) (which by definition must be a 


positive function) the two terms on the right hand side of (1.4) must be 

negative. $(u) must decrease strictly monotonically with u and has a unique 
maximum at u = 0. 


Thus whatever the distribution of the rotation the most likely projected 
velocity is zero. This result is similar to that obtained by Ullman (1979) 
for the motion of dots. It was shown that if the motion of a random dot is 
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described by an isotropic probability distribution function in three dimensions 
then the probability distribution for the projected two-dimensional motion is 
peaked at 0. 

Note that our result is independent of whether we choose an upper bound 
for r. This can easily be seen by setting r max ^ oo and w ^ 0 in (1.4). In 
fact having an upper bound for r makes d$/du more negative and makes 
$(u) decay faster. Henceforth we assume for simplicity that there is no upper 
bound for r. 

To see the connection with the smoothness assumption observe that in 
the limit Hildreth’s smoothness measure can be expressed as 


/l£l’*-£<§>’ (1.5) 

where the sum can be taken over a set of rigid rotating rods. The results above 
show that for each rod considered independently the probability distribution 
of the u is peaked at zero. Thus, with this independence assumption, we 
argue that the most likely distribution of the whole contour is the one that 
minimizes (1.5). We will relax the independence assumption in section 4. 

Section 2. The three-dimensional case. 

We now extend the analysis to a rod moving in 3-space. Consider a rod 
of length r projected into the image plane, which has unit normal vector k. 
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The rod’s direction in 3-D space is denoted by r which is a unit vector in the 
direction r. The rod is projected into a vector f p where 

f p = r- (r • k)k. (2.1) 

The rod s rotation is described by a vector where to is the frequency and 
to is the axis of rotation. The velocity v is given by 

v = Cox r. (2.2) 

The projected velocity field v p is given by 

v p = v-(v-k)k. (2.3) 

We consider rods with projected length R and projected velocity U. We are 
interested in the projected velocity distribution $(£/). Since the projected 
velocity distribution is rotationally symmetric we can express this as U$(U) 
(see Appendix 1). If the rods’ length distribution is 4> r (r) and their rotation 
distribution is then the projected velocity distribution is given by 

$(u) = j S(R - \r p \)8(U - |u p |)$ r (f)$ a; (u;)dfdu;. (2.4) 

Care is needed in specifying the domain of integration of (2.4). From (2.2) 
we see that only the component of w perpendicular to r contributes to the 
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velocity. We must require £ • P = 0. We impose this by substituting a delta 
function into (2.4) and then integrating over all u;. 

Thus we have 


V*(V) = /HR - l»vl)<(<3 • ?)6(U - \v p \)$Ju)drdS. (2.5) 

We assume all directions of the rod are equally likely and the rods are 
also equally likely to have any length. So we set 


*(r) = 1. (2.6) 

We also assume that the rotation is equally likely to be in any direction. Then 
$ w (d5) is a function of |cD| = u> only. 

U *(V) = J 6 ( R - l»pl W3 • - K\)*„(u)drda. (2.7) 

Choose an orthogonal basis i, J, k. Define angles 0, <p y a, (3. These angles 
are illustrated in figure 1. 0 is the angle between the unit vector and the k 
axis, ip is the angle between the unit vector projected onto the x,y plane and 
the x-axis. Similarly for a and j3. It follows that 


r = sin0 cosipi + sin0 simpj + cos0k 
u> = sina cosfli -j- sina sinfij -j- cosak 


( 2 . 8 ) 
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Figure 1 Definitions of the angles, see text. 
Then 


and 


duj = du sina dad(3 
df = dr sxnO dOd<p 


(2.9) 


|Fp| = rsini. 

Define the angle between <3 and F to be r by 


( 2 . 10 ) 


cost = uj • r. 


(2.11) 
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Then from (2.8) we have 


cost = cosOcosa + sinO sinacos(<p — (3 ). 


( 2 . 12 ) 


Define the angle p by 


(wxf) r 
cosp = ’ . Jc. 

|a; X rj 


From (2.11) we obtain 


(2.13) 


cospsinr — (u x r • k). 


(2.14) 


From (2.8) we find 


cospsinr = sinOsina(<p - (3) 


(2.15) 


and we calculate 


| v p | = usinr sin p. (2.16) 

We use (2.10), (2.11) and (2.16) to write the delta functions as 

f>{R—\r p \)f)(£'r)6{U—\v p \) = 6(R-r sin0)6(cosr)6(U-Or sinr sinp). (2.17) 
We now need to change the variables of integration. We have 
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dujdr = du>dr sina sinB dad(3dBdtp. 

The integrand only depends on tp and (3 as <p - (3. We can set 
integrate out (3. Then we have 


(2.18) 
ip = (fi — (3 and 


cost = cosB cosa -f sinB sinacosip 

cospsinr = sinB sina sinip • (2.19) 

dudr = 7r dudr sinasinB dadipdB 
Now we must change the variables of integration from a, ip to T,p : 


dadip — det 



drdp. 


From (2.19) we eliminate the terms containing ip to obtain 


( 2 . 20 ) 


cosot - cost cosO ± sina(sin 2 B - cos 2 p )%. 
Define functions F(r,p,a,ip ) and<7(r,/>,a, ip) by 


( 2 . 21 ) 


F(r,p,a,iP) — cost — cosBcosa — sinB sinacosip 


( 2 . 22 ) 


p,a,ip) = cospsinT - sinB sina sinip 

It is a standard result of Jacobian transformations (it can be obtained by 
using formula (2.20) twice, once changing variables from a, ip to F,G and 


then changing F, G to r, p) that 
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dadip = det 


From (2.22) we obtain 


dF dF 
br bp 

dG dG_ 
br dp 


/det 


dF dF 
ba bip 

dG dG 
ba dtp 


drdp. 


(2.23) 


dF dF 
br bp 


dG dG 
dr dp 


• 2 

= sin t sinp 


(2.24) 


( dF dF 
ba bip 

dG dG 
da dip 

Thus we calculate 


— sinO sina{sinO cosa — cosip cosO sina} . (2.25) 


dadiP = -_ , M'rstnp _ 

sinO sina{sinO cosa — cosip cosO sina} ^ 

We substitute for cosip from (2.19) and obtain 


(2.26) 


, ,, sin 2 t sin p 

da dip = -— -- drdp 

sma\cosa — cosO cost} r 


then using (2.21) we find 


. ,, smrsmp 

dadip = — - L. _ drdn 

sina(sin 2 0 — cos 2 p)k 


Hence 


(2.27) 


(2.28) 


sina sinOdadip = - s ^ nT 3 * n P . drdp 

* (sin*0 - cos*p)h ap ' 


(2.29) 
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We substitute (2.17), (2.18) and (2.29) into (2.7) 


U$(u) — JS(R — rsin9)S(cosr)6(u — ursinr sinp) 

, , x sinrsinpsinQ , , _ 

^u;(^) — -- i drdpdOdwdr 

(stn 2 9 — cos 2 p)^ 

Now we do the integration with respect to r to obtain 


(2.30) 


U$(U) = J £ 1 ^ ~ r sinO)6(U — ursinp) 


- rsinojo^u — urstnp) _ 

(7tn 2 0-c<wV)i- $u ,(u)sinpsinedpdedudr. (2.31) 


We integrate with respect to 9 to obtain 


{/$(„) = / ^ - ^rsinp)^Jij)sinp(R/r)dpdudr 

J O 2 -R 2 'll(R2/r2 ' (2,32 ^ 


(r 2 - £ 2 )*(J? 2 /r 2 -cos 2 p)i 
We integrate with respect to p and obtain 


*(U) = J 


R$u,(u})du>dr 


(2.33) 


r(r 2 - R 2 )b(R 2 u 2 + u 2 - u 2 r 2 )±(u; 2 r 2 - u 2 )* ' 

The domain of integration is restricted to the region of the u - r plane where 
the integrand is real (for simplicity we have omitted the bounds of integration 
in the previous equations). It is specified by 


r > R 


R 2 lj 2 + u 2 > u 2 r 2 


(2.34) 


wr > u. 
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Change the variable of integration from r to X where 


u> 2 r 2 =u 2 + X 


(2.35) 


then 


*(«) = j 


___ Ru$ u (u)dudX _ 

2 Xi(R 2 u 2 - X)i(u 2 + X - u 2 R})i(i ? + X) 


(2.36) 


with domain of integration 


X < R 2 uj 2 
X>0‘ 
u 2 + X > u 2 R 2 


(2.37) 


Define a new variable Y by 


Y 2 = uj 2 R 2 - X 


(2.38) 


then 



_ Rv$u(u;)cLjdY _ 

(uj 2 R 2 - Y 2 )7(u 2 - Y 2 )7(u 2 + u 2 R? - Y 2 ) 


(2.39) 


with 
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Y > 0 


Y < ujR 


(2.40) 


Y < u. 

We can further simplify this expression by the substitutions Y = usinO 
and u> = (u/R)Q. This yields 


1 f°° 

*(«) = -7 / d6 dSl- 

u2 JO JainB \ 


,(uQ/R) 


l.in» - «»n J 9)i/2(fi2 +cos 2gy (2- 4 l) 

It is clear from this expression that $(u) will decrease with u if and only 
if $ w (w) does not grow faster than u> 2 . Thus for all realistic cases $(u) will 
be a monotonic decreasing function of u. 


Section 3. Expansion and Contraction. 

We now consider the situation in two dimensions when the rod is allowed 
to expand and contract as well as rotate. We can write 


r — rr 


(3.1) 


and differentiating gives 


r = rr + r$h 

where h is the unit vector perpendicular to 


(3.2) 


We define the expansion coef¬ 


ficient s by 
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r — rs 


and write (3.2) as 


r = rsr + rOh. 


The projected velocity is then given by 


(3.3) 


(3.4) 


U = r s sinO + r u> cosd 


(3.5) 


where 9 is the angle that f makes with the normal to the image plane and 
^ The projected velocity distribution is given by 


*( £r ) = / HR ~ rsin»)i(U - (rssine + rwcos»))$,(s)*„(u)drdudsd» 

(3.6) 

where, as in Section 1, we have assumed that $(r) = 1 so the rods have no 
preferred lengths. We do the integral of $(£/) with respect to 9 to obtain 

= J-R 2 ) l ^ 2 S(U- sR-u(r 2 - R?) l t 2 )$ 3 (s)$u(u)dr du ds. (3.7) 
We now integrate with respect to r to find 

= J{(U ~ S R ) 2 + w 2 R 2 )~ l / 2 $ a (s)$ u (w)du)ds. 


(3.8) 
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Care must be taken to ensure that this integral is evaluated over the correct 
limits, those for which the integrand is well defined. For w> Owe need s < ^ 
and for u> < 0 we have s > This domain of integration is shown in figure 
(2). We can split the integral up into two parts 


*(£0 = *!(Z0 + *2(£0 (3.9) 



where _ - 


oo r t=U/R 

*i(U)= / du ((U-sR? + R 2 u 2 )- 1/2 i,(s)* u (u)da (3. 

J <jj —0 J «= — oo 


10 ) 


and 
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+ R 2 0J 2 )-^ 2 i,(s)^(u)ds. 


(3.11) 


We impose the conditions 


*.(*) = *s(s) 


(3.12) 


and 


$u(u) = *„(-«). (3.13) 

These ensure that contraction is as likely as expansion and that rotation is 
equally likely to be any direction. 

We use (3.12) and (3.13) to rewrite (3.9) as 


ruj=oo ra=U/R 

W) = / du ((V- sR) 2 + R 2 u 2 )-'/ 2 *,(s)<iJ u )d s 

JLJ—0 J 8——00 

ruj-oo ra—-U/R 

+ du ((U + sR) 2 + (3.14o) 

J tjj—G Ja= —oo ' 

We now substitute t = Rs/u and w = uti/R and obtain 


u /' n=0 ° r t= i 

*( U ) = R? L 0 in ~ * )2 + n2 )' 1/2$ *( u< /^)^^(«n/^)«il 

U f Q=oc f t= ~ l 

+ wj n=0 dn J t= ((■ 1 + t ') 3 + sl2 )~ 1/i *'(»t/R)*Uun/R)dt. (3.146) 
Note that if we set $ s (ut/R) = 6(ut/R ) we recover (1.3). 
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We differentiate (3.14a) to obtain 


d<$> _ _ 
dU ~ 


ru>— oo 

J u>=0 




du 


£ 


3=-U/R 


{{U-sRf+R 2 <J 


a— — oo 


) 3/2 (tf-,sA)$,(*)$4 w )<fc. (3.15) 


We can simplify this expression by setting a to s - 2U/R in the second term 
on the right hand side. This yields 


du ~ ~ Lo d “L_„ (XU + sR ) 2 + ^2^2)3/2( 3i2 +^)( $ 3(5)-$ s (s+2f//if!))$ 

(3.16) 

In the range of integration (u -}- &R ) is always negative. So the integral will 
be always negative provided $,(*) - $,(s + 2 u/R) is negative for s < -u/R. 

If we make s positive, using (3.12), this becomes 


$ 3 (s - 2 U/R) - *,(j) > 0, (3.17) 

which is true for all monotonically decreasing functions. Then we have fj^ < 0 
everywhere for any function $„(«). Hence the projected velocity distribution 
will once more be peaked about (7 = 0. 

If we relax the conditions (3.17) we are no longer assured of having a 
monotonically decreasing projected velocity distribution for all If 


(u>)ds. 
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$ 3 (s) is linear in s we obtain a flat distribution 

$(£/■) = const (3.18) 

If $a(s) is quadratic in s we find 

-2 + J W)- 3/2 ^$„(w) (3.19) 

which will only be negative for some distributions $ w (c«;). 

Thus allowing the rod to expand and contract reduces the strength of the 
result of Section 1. But if we make the reasonable assumption that $,( 5 ) is 
at most linear in 5 the result will still hold. 

Section 4. Curves from rods. 

The situation becomes more complex when we consider several rods 
joined together to form a curve. The results above show that for each rod 
individually the projected velocity distribution is peaked at zero. If the rods 
are joined, however, these probability distributions are no longer independent. 
We now sketch an argument suggesting that this loss of independence does 
not affect the result. 

Suppose we have a set of probability distributions Pi(x{), i = 1 ,.JV 
which are all peaked at zero. We now define the joint probability distribution 
P{x) where x = 2 , ...,£/v). If we impose no constraints this distribution 


is given by 
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P(x)dx = (4.1) 

Now impose a consistency constraint £ ■ x t - = 0. We now have 

J P(x)dx = J niPi(xi)6(^2xi)Tlidxi. (4.2) 

i 

The x.’s can no longer vary independently and the delta function imposes the 
consistency constraint. We can get integrate out the delta function thereby 
reducing the number of independent variable to N - 1. It is convenient to 
choose these to be x* — x^+i, for i = 1 N — 1. We can now write (4.2) as 

J P(x)dx = J n iPi(xi - Xi+i)Uid(xi - x <+1 ). (4.3) 

We can set y,- = X{ — x^j, i = 1,..., N — 1 and rewrite 

P(y) = Pi(yi)P2(y2)-PN~i(yN-i)PN(-yi - y 2 - ... - yN- 1 ). (4.4) 

It is straightforward to see that the maximum value of P(y) occurs when the 
yi are all zero. Thus P is still peaked at zero even with the constraints. 

Section 5. An alternative approach. 

The results derived in the last few sections support the assumption (Hil¬ 
dreth 1984) that the velocity field along a contour is smooth. This assumption 
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is used to solve the aperture problem by prescribing the smoothest possible 
velocity field consistent with the data. 

An alternative approach to the aperture problem was taken by Waxman 
and Wohn (1986). They showed that if the object was locally planar and 
moving rigidly then, assuming perspective projection, the local velocity field 
on the image plane would be locally quadratic in the x,y coordinates. They 
then defined regions in which these expansions were valid and checked for 
consistency between these regions. In these regions they could do a least 
squares best fit to find the coefficients of these quadratic polonomials, and 
hence the velocity field. 

This approach, however, can also be used to justify the smoothest velocity 
field assumption. The orthographic projection of the motion of a rigid body 
will obey 


v x = A + By + Cz, 


(5.1a) 


v y = D + Ex + Fz, 


(5.16) 


where A, B , (7, D , E , F are constants and z is the (unknown) depth coordinate. 
If we also assume the object is planar then z obeys 
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z = px + qy + s, (5.2) 

where p y q, r are constants. Substituting (5.2) into (5.1) gives linear expres¬ 
sions for v x and v y in terms of x and y. So if we assume local planarity and 
local rigidity (in the style of Waxman and Wohn (1986)) the velocity fields 
will locally be linear in x and y. The measure of smoothest velocity, I(v), 
used by Hildreth is the integral along the curve of the function 



dv 

a? 


(5.3) 


where s is the arc length. The velocity fields will be locally linear if and only 
if J(v ) is zero. Thus we can think of the smoothest velocity field approach as 
a local method of assuming local rigidity and local planarity. 


Section 0. Conclusion. 

The arguments in the first four sections of this paper suggest that locally 
rigid, or semi-rigid objects, will tend to project a smooth velocity field in 
the image. Moreover, assuming random motions and limited expansion or 
contraction, this field will tend to be as smooth as possible. In the fifth 
section we noted that rigidity of an object and local smoothness of its surface 
will also lead to a smooth image motion. 
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These arguments support the view that maximixing smoothness is a good 
heuristic to use for motion correspondence and that it is a sensible way to solve 
the aperture problem. 
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Appendix 

We first describe the general method for integrating delta functions. 
Suppose we have an integral /(a, 6) 


/(a,6)=/ f(x)6(x - x 0 )dx (A.l) 

J a 

where 6(x) is the Dirac delta function, f(x) is an arbitrary function, x 0 an 
arbitrary point and b > a. The value of the integral is 


I(a y b) = f(x o), if x 0 e[a,b] 


(A.2a) 


I(a,b) = 0, otherwise. 


(A.2b) 


This result can be generalized to integrals of form 
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J(a,b) = f f(x)6(g(x) - c)dx 
J a 


(A. 3) 


where g(x ) is an arbitrary function and c an arbitrary number. All points X{ 
with g(xi ) = c will contribute to this interval. Suppose there is only one such 
point. If there are several we can divide the integral up into regions with only 
one such point. Consider one such point x = 0. The function g(x) can be 
expanded in a Taylor series about this point 


g(x) = c + g'( 0)(x) + 0(x 2 ). 


(A A) 


If we change the coordinate to u where u = ^(O)^ we can write the 


integral as 


J(a,6) = / f(u/g'(0))6(u + 0(u 2 ))-—. (A. 5) 

«V(o)a flr(0) 

The value of the integral will depend on the sign of ^(0). If it is negati ve 
the bounds of the integral will be reversed and the integral will change sign. 
Therefore 


J( o,6) = /(0) 


|S'(0)I’ 


0e[a, 6] 


(A. 6a) 


J(a,b) = 0, otherwise. 


(A. 66) 
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We now consider the form of the probability distribution function for a 
rotational symmetric vector in two-dimensional space. Suppose the function 
is $z(Q)du. If it is rotationally symmetric (and hence depends only on the 
modulus u> of Q) it can be written 


$z(£j)dCo — $ u (L>)udud<p y (A.7) 

by changing to radial coordinates u>,<p in the uj space. The component can 
be integrated out to give a distribution u$ u {u)du. 
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